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ABSTRACT 

An evaluation was conducted of the second year of a 
2-year renewal program at two high schools in Brooklyn (New York 
City), the Asian and Arabic Mediated Enrichment Resource and 
Instructional Career Awareness Program (Project AMERICA), originally 
designed to ease the transition of Arabic and Chinese-speaking 
immigrant students to life in America, but the Arabic-speaking 
component was phased out in 1989. Focusing on basic skills, career 
development, and preoccupat ional training, the project proposed to 
provide services to students of limited English proficiency (LEP) 
with limited reading and writing abilities in their native language. 
The design included staff development; dissemination of bilingual 
newsletters; meetings and English as a Second Language (ESL) classes 
for parents; development of curricular materials; intensive student 
instruction in ESL and Chinese Native Language Arts (NLA); and 
courses in science, mathematics, social studies, and preoccupat ional 
training in the native language. During the 1991-92 school year, the 
project enrolled 432 Chinese, 5 Vietnamese, 2 Arabic, 2 Spanish, 1 
French, 1 Russian, and 5 unreported 9th through 12th grade students • 
Prcject AMERICA met objectives for NLA, career education, parent 
involvement, and attendance. It did not meet objective for ESL and 
attitude toward cultural heritage. It met the objective for content 
area subjects and dropout prevention. It did not meet objectives for 
staff development and career advisement* It partially met the 
objective for cultural enrichment and curriculum development. It met 
the objective for attitude toward school. This was the last year of 
programming, and no suggestions or recommendations were made for 
meeting unmet or partially met objectives. Appendixes describe data 
collection and analysis and instructional materials. (RLC) 
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FOREWORD 



The body of this report is preceded by an Extract which presents an overview of salient points of 
the project: funding cycle; enrollment figures; background of students served; admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

The extract is followed by the body of the report, titled Program Assessment . This includes such 
information as staffing, program implementation, and outcome and implementation objectives. 
Instructional objectives are presented first, followed by noninstructional objectives. The report then 
addresses those aspects of programming mandated by Title VII regulations that do not have specifically 
stated objectives. This may be information on attendance and dropout rate, grade retention, 
mainstreaming, referrals out of the program to meet special needs of the students, and withdrawals. A 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described m Appendix A following the text. 
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EXTRACT 

FUNDING CYCLE: Year 2 of 2-year renewal cycle 

SITES 



School 

Fort Hamilton High School 
Lafayette High School 



Borough 

Brooklyn 
Brooklyn 



Grade Levels 

9-12 
9-12 



Enrollment* 



(fall) 
258 
172 



(spring) 
214 
171 



*The project enrolled 448 students (40 more than in the previous year), 372 of whom participated both semesters. 
Male students numbered 225, female 220; gender was not stated for three. Students served totaled 430 in the fall 
and 385 in the spring. 



STUDENT BACKGROUND 



Native Language 

Chinese 
Mandarin 
Cantonese 
Other 

Vietnamese 

Arabic 

Spanish 

French 

Russian 

Unreported 



Number of Students 



19 
409 
4 



432 



5 
2 
2 
1 
1 
5 



Countries of Orig in 

China 

Hong Kong 

Vietnam 

Taiwan 

Other 

Unreported 



Number of Students 

357 
61 
13 
3 

12 

2 



Median Years of Education in Native Country : 7,0: in the United States : 3,0 

Percentage of Students Eligible for Free Lunch Program : 38.4 

About ten percent of the students were recent immigrants from rural areas of China, where they had 
received a very limited education. At Lafayette High School many project students lacked time to study because 
they held part-time or even full-time jobs after school. About 20 percent of the LEP students were not recent 
immigrants and 30 percent were not literate in their native language. 



ADMISSION CRrTERIA 

Project AMERICA admitted Chinese-speaking students, most of whom had scored at or below the 40th 
percentile on the Language Assessment Battery (LAB) and thus were classified as limited English proficient 
(LEP), A small number of English proficient students opted into the program in order to learn about their 
cultural heritage and improve their native language skills. In se.jcting students, the project also took into account 
academic transcripts from native countries and teacher recommendations. 



PROGRAMMING 



Design Features 

Project AMERICA was originally designed to ease the transition of Arabic- and Chinese-speaking 
immigrant students to life in America, but the Office of Bilingual Education and Minority Language Affairs 
(OBEMLA) granted permission to phase out the Arabic-speaking component in 1989. Focusing on basic skills, 
career development, and pre-occupational training, the project proposed to provide services to LEP students who 
were also limited in their ability to read and write their native language. The design included staff development, 
dissemination of bilingual newsletters at both sites, meetings and E.S.L. classes for parents, and development of 
curricular materials. Students were to receive intensive instruction in English as a Second Language (E.S.L,) and 
Chinese Native Language Arts (N.LA.)» courses in science, mathematics, social studies, and pre-occupational 
training were to be offered in the native language. 

Capacity building. V\is was the project's final year of Title VII funding, and the project director reported 
that tax-levy monies would be used at both sites to support all project staff as well as parental activities and 
cultural trips. Details furnished by the resource teachers, however, suggested that services to the target 
population had already diminished with the reduction of Title VII funding and would be further cut when that 
funding was eliminated. 

Strengths and Limitations 

For the most part. Project AMERICA carried out the activities it had proposed in its design. 

The project was unable to meet the linguistic needs of many students at Fort Hamilton High School 
because of the gap between Mandarin-speaking staff and Cantonese-speaking students. There were insufficient 
funds available for proposed cultural activities as well as tuition assistance for Title VII staff at Lafayette High 
School. Staff had to help cover costs of subway transportation and celebrations out of their own pockets. 



CONCLUSIONS 

As in the previous year, Project AMERICA met objectives for N.L.A., career education, parent 
involvement, and attendance, and did not meet the objectives for E.S.L, and attitude toward cultural heritage. It 
fully met the objective for content area subjects and dropout prevention, only partially met the previous year It 
failed to meet the objectives for staff development and career advisement, and met the cultural enrichment 
objective only partially-all of which it had met the previous year. On the other hand, it met the objective for 
attitude toward school, which it had not met in the previous year. The project partially met its long-range 
objective for curriculum development. This was the last year of programming, and no suggestions or 
recommendations were made for meeti»ig unmet or partially met objectives. 
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PROGRAM ASSESSMENT 



STAFFING 



Title VII Project Staff (Total 6) 



Title 


Degree 


Laneuage Competencies 


Title VII Funding 


Other Funding 


Project Director 


M,A. 


Chinese 


Full time 




Resource Specialist 


M.Ed. 


Chinese 


Part-time 


Tax- levy 


Resource Specialist 


M,A. 


Chinese 


Part-time 


Tc v-levy 


Paraprofessional 


High School 


Chinese 


Full time 


Paraprofessional 


B.A. 


Chinese 


Full time 




Office Aide 


High School 


Chinese 


Full time 





The office aide worked at the central office of Title VII programs. 
Other Staff Working With Project Students (Total 50) 

Language Competencies and Teaching 
Titles Degrees Certifications Communicative Proficiencies (TP/CP) 



Teachers 


47 


Ph.D. 


1 


E.S.L. 


16 


Guidance 




M.A./M.S, 


33 


English 


4 


Counselor 


1 


B.A/B.S. 


14 


Mathematics 


1 


Paraprofessionals 


2 


High School 


2 


T.P.D. 


12 










Social Studies 


7 










General Science 


2 










Spanish 


1 










Music 


1 










Guidance 


1 



Chinese 8 TP, 2 CP 



The project director said that staffing at the two schools was unchanged from the 1990-91 school year. 
OREA was unable to ascertain whether any of the twelve teachers at Fort Hamilton High School who had been 
listed as holding only Temporary Per Diem ceriificaiion had upgraded their credentials. Of the remaining staff at 
both sites, all but four held certification in the areas they served. 



Teaching Proficiency (TP): Competent to teach in this language. 
Communicative Proficiency (CP): Conversational capability only. 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 
En glish as a Second Language fE.S.L.) 

E.S.L. CLASSES 



Sites l evel Periods Weekly Students Enrolled 

Fort Hanmion High School Beginning 15 44 

Intermediate 10 127 

Advanced 10 83 

Lijfayette High School Beginning 10 76 

Interniediaie 10 25 

Advanced 10 19 



Instructors at Fort Hamilton High School relied on a whole-language approach emphasizing dialogue and 
cooperative learning in small groups. Staff at Lafayette High School reported using a variery ot approaches, 
including the audiolingual method^ the notional-functional approach, and the methodology of total physical 
response. For a list of instructional materials, see Appendix B, 

• As a result of participating in the program, 70 percent of the targeted students will demonstrate an 
appropriate increase in English language proficiency. 

Evaluation Instrument: Language Assessment Battery (LAB)* 

Pretest! May 1991: postiest: May 1992. 

Number of students for whom pre- and posttcst data were reported: 328 

Percent of students with pretest/posttest gains: 45.1 

Mean gain: 2,5 N,C,E,s (s.d,=8,5) 

Mean gain is statistically significant (f=5.40, p<.05). 

Fewer than 70 percent of the students showed gains on the LAB. 

Project did not meet the E.S.L. objective. 



OREA used a gap reduction design to evaluate the effect of supplementary instruction on project students' 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no vjlid 
comparison group exists among these students, and OREA used instead the group on which the LAB was 
normed. Test scores are reported in Normal Curve Equivalents (N,C,E.s), which are normalized standard scores 
with a mean of 50 and a standard deviation of 21,06. It is assumed that the norm group has a zero gain in 
N.C,E,s in the absence of supplementary instruction and that participating students' gains are attributable to 
project services. 



Native Language Arts (N.L.A.'j - Chinese 

Students lacking literacy skills in native language (estimated): 30 percent. 

N.L.A. CLASSES 



High School Level Periods Weekly Students Enrolled 

Fort Hamilton Beginning 5 50 

Intermediate 5 120 

Advanced 5 60 

Lafayette Beginning 5 20 

Intermediate 5 60 

Advanced 5 60 



N.L.A. classes at Fort Hamilton High School emphasized role-playing and other forms of dramaiizaiion. 
At Lafayette High School, as a resuh of scheduling constraints and the fact that there was only one N.L.A. 
teacher, students at different levels of proficiency were placed in the same class; the instructor combined oral 
discussions with practice in expository writing. For a list of instructional materials, see Appendix B, 

• As a result of participating in the program, 75 percent of the targeted students will increase in 
Chinese language achievement. 

Evaluation Indicator: final course grades. 

Of the 233 students who enrolled in Chinese N.L.A. courses in the fall, 9L8 percent received passing 
grades; of the 254 enrolled in the spring, 84.3 percent received passing grades. 

Project met N.L.A. objective. 



Content Area Subjects 

All content area subjects were taught for five periods a week. Fort Hamilton High School offered nuist 
courses bilingualJy: a few courses were also taught with a sheltered English methodology^ and advanced 
mathematics was available only in the mainstream. Staffing limitations led to overcrowding in some bilingual 
classes, but this problem was resolved after the United Federation of Teachers (U.F.T) intervened. At Lal.ivciic 
High School, all mathematics courses were taught in the mainstream; social studies and science courses were 
available bilingually. Each site offered pre-occupational bilingual courses in typing and/or computer liicraa. 

At Fort Hamilton High School, project staff felt that students who were not literate in their native 
language labored under the particular difGculty presented by the use of Mandarin by instructional staff raihor 
than the more familiar Cantonese. This language gap also proved troublesome in social studies. 

Instructional materials used are listed in Appendix D. 
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• As a result of participating in ihe program, 70 percent of the targeted students will score ar or aN^vc 
the 65 percent passing criterion in the content subject areas (tnattiematics, social siudies, and 
science). 

PASSING GRADES IN CONTENT AREA COURSES 



High School Fall Spring 

Subject Enrollment Percent Passing Enrollmeat Percent Passing 

Fort Hamilton Mathematics 210 81.0 202 75.2 

Science 126 79.4 113 88.5 

Social Studies 199 84.9 191 85.9 

Lafayctie Mathematics 133 90.2 141 81.6 

Science 141 84.4 135 S3.0 

Social Studies 160 85.0 151 87.4 



Project met the content area objective both semesters in all subjects. 

Attitude Toward Cultural Heritage 

At each site, project staff organized activities, including a ping-pong tournament and an after-school 
Chinese New Year party. The Chinese Culture Club at Fort Hamilton High School sought to ease assimilation 
for project students. 

• As a result of participation in the program, 75 percent of ;he students will demonstrate an 
improvement in attitude toward Cultural Heritage by at least one scale unit on a five-point scale. 

The project administered an OREA-dcvelopcU Likert scale-iype questionnaire to 119 project students. 
Three questions asked students to assess, on a scale from one lo five, how their participation in the project had 
affected their attitude toward their cultural heritage. Ten (8.4 percent) of the respondents averaged 4.0 or hidier 
(one scale unit above the midpoint that represents 'no change') in their responses. 

Project did not meet objective for students' attitude toward cultural heritage, 

Atthude Toward School 

• As a resuU of participation I'n the program, 75 percent of the students will demonstrate an 
improvement in attitude toward school by at least one scale unit on a five-point scale. 

The project administered an OREA-developed questionnaire to 119 project students. Three questions 
asked students to assess^ on a scale from one to five, how participation in the project had affected their attitude 
toward school. One hundred six (89.1 percent of the respondents) averaged 4.0 or higher (one scale unit above 
the midpoint that represented 'no change') in their responses to these questions. 

Project met objective for students' attitude toward school. 
Career Advisement 

• All graduating students will meet with the bilingual career specialists for advisement at least three 
times during the school year. 

Of the 103 graduating students^ only one was reported to have received career counselling at least three 
times during the school year. 

Project did not meet career advisement objective. 

It 
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Career Education 



• The program will organize at least one conference for students in which representatives of business 
and industry will present information on career options and skills requirements. 

In conjunction with other central Title VII programs for Chinese- speaking students. Project AMERICA 
organized a career day at the Brooklyn Campus of Long Island University. Guest speakers described typical 
experiences and skills requirements in twelve professions. 

Project met career education objective. 



Cultural Enrichment 

• The program will organize at least two field trips to historical museums, the United Nations, the 
White House, etc., to increase familiarity with American culture and citizenship. 

At Fort Hamilton High School, the project organized trips to the Statue of Liberty and the Intrepid Sea- 
Air-Space Museum on the Hudson River. At Lafayette High School, Title VII funds were not allocated for trips, 
and the trips that were arranged focused on Chinese rathcT than American culture. 

Project partially met cultural enrichment objective. 



Other Activities 

The project published a monthly newsletter at each site. 



Attendance 

• As a result of participation in the program, students' attendance will be significantly higher than that 
of mainstream students. 

ATTEND.^VNCE RATES 

High School Project Students Mainstream Students Difference 

Fort Hamilton 95,7 82.9 12.8* 

Lafayette 93,9 78.5 15.4* 

*p<.05 

The previous year's attendance at Lafayette High School was 92,2 and at Fort Hamilton High School it 
was !^5.5 percent. 

Project met attendance objective. 



Field trips, cultural activities, and the personal interest of project staff were intended to encourage 
students to stay in school. 

• As a result of participation in the program, the dropout rate of ihe students will be significantly lower 
ihan thai of similar non-program students. 

DROPOUT RATES 

High School Project Students Mainstream Students Difference 

Fort Hamilton 0.7 22.8 22.1* 

Lafayette 0.0 14.7 14.7* 

*p<,05 

Project met dropout prevention objective. 
Grade Retention 

Tliirty-six students (8 percent of the participams) were retained in grade. The project did not propose an 
objective for this area. 

Enrollment in Post-secondary Institutions 

None of the graduating students were reported as applying for enrollment in post-secondary education 
institutions. Tlie project did not propose an objective lor this area. 

Students With Special Academic Needs 

Referral to special education. Teachers referred students whose ability to function in the program was in 
Houbt to a School-based Support Team (S.B.S.T.) of clinicians. No members of the S.B.S.T. at either school 
spoke Chinese, but the team called in project staff to translate when necessary. 

At Fort Hamilton High School, the project served two students who had been certified to receive special 
education services. 

Remedial programs. No students were referred to remedial programs. 

Gifted and talented programs. No students were referred to gifted and talented programs. 

Mainstreaming 

Project AMERICA mainstreamed none of its students. 



Academic achievement of former project students in mainstream. The project did not report 
performance data on any of the ten students mainstreamed in the previous year. 



Staff Development 



• Ninety percent of program staff members will enxoU in at least one college or university course each 
semester. 

As in the past, it was agreed that OREA would evaluate this objective with reference to Title Vll-funded 
program staff only. Three of the six (50 percent) took university courses during the year under review. 

Project did not meet staff development objective. 



Staff Awareness of Pupil Needs 

• As a result of participation in the program, tlicrc will be an increase in awareness of pupil problems 
and needs on the part of at least 80 percent of ilie staff. 

The projeci administered an OREA-dcveloped questionnaire to 26 staff members. Two questions asked 
the staff members to assess on a scale from one to five the extent to which participation in the project had made 
them more aware of students* problems and needs. Tweiiry-two (84,6 percent) of the respondents averaged 4.0 or 
higher (one scale unit above the midpoint that represents 'no change') in their responses to these questions. 

Project met staff awareness objective* 
Curriculum Development 

• By the fifth project year, the curriculum specialists will have developed or translated one subject- 
matter oriented instructional unit for teaching each of the following: English as a second language, 
mathematics, science, and social studies. 

In conjunction with other centr: itle VII programs serving Chinese-speaking students. Project 
AMERICA developed at least two instructional units for leaehing mathematics, science, and social studies. The 
project did not report developing any units for teaching l:.S.L. 

Project partially met curriculum development objective. 



Parental Involvement 

At each site, about 15 parents participated in an I:.S,L. class that met for six hours each week during 
most of the school year. The resource teacher at LaCayette High School reported frequently telephoning parents 
late in the evening after they came home from work. 

• As a result of participating in the program, students parents who participate in open school 
day/eveaing will be equal to or greater than the proportion of mainstream students* parents who 
participate in that activity, 

PERCENTAGE ATTENDANCE RA IllS AT OPEN SCHOOL DAY/EVENING 

Hi gh School Project Parents Mainstream Parents 

Fort Ha.Tiilton 40.0 6.2 

Lafayette 10.0 9,9 

Project met parental involvement objective. 



CASE HISTORY 



Lisa J. entered the project in the fall of 1989 as a sophomore at Lafayette High School. Recently arrived 
from Canton, China, she spoke hardly any English and found the transportation system bewildering. She was very 
discouraged, but her parents convinced her that school would enable her to escape the kind of menial jobs which 
would otherwise be open to her. She made phenomenal progress in E.S.L., and b her junior year, she moved 
into mainstream English courses on the resource teacher's recommendation. At her graduation in June 1992, she 
delivered the salutatorian*s address. Several colleges offered her scholarships: she was interested in becoming a 
pharmacist. 
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APPENDIX A 



DATA COLLECTION AND ANALYSIS 



COLLECTION 

OREA evaluation consultants visit sites and interview key personnel. The project director gathers data 
and, with the consultant, completes forms (as shown below) as necessary. 

Student Data Form 

This one-page form is filled out by staff for each panicipaling and mainstreamed student. OREA gathers 
data from this form on backgrounds, demographics, academic outcomes, attendance, referrals^ and exit from the 
program. 

Project Director's Questionnaire 

The Project Director's Questionnaire includes questions on staff qualifications, program implemeniaiion, 
periods of instruction, and instructional materials and techniques. 

Project Director*s Interview 

The interview gathers information on program and student or staff characteristics not supplied by the 
Project Director's Questionnaire, The interview also allows project staff to offer qualitative data or amplify 
responses to the questionnaire. 

Citywide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (LAB) and other citywide tests. 
For evaluation purposes, these test scores are reported in Novmal Curve Equivalents (N.C.E.s), N.C.E.s are 
normalized standard scores with a mean of 50 and a standara uevialion (s.d.) of 2L06, They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores, A gain of 5 N.CE.s is the same 
whether it is at the lower or the higher end of the scale. N.C.E,s can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although more familiar to many, are unsuitable for such computations 
since they are not equal-interval.) 

Likert-Tvpe Surveys 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, are used in a 
variety of ways. They examine studem attitudes (i.e., toward school and career, native language use, and native 
and mainstream cultures). They also assess staff and parent attitude and reactions to workshops and other 
activities. 



ANALYSIS 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardi2 i tests. Since no appropriate 
non-project comparison group is available in New York City, where all students of limited English proficiency 
(LEP) are entitled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on v/hich the test was normed. It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. Scores are 
reported in Normal Curve Equivalents (N,C,E,s), which are normalized standard scores with a mean of 50 and a 
standard deviation of 2L06. (See "Citywide Test Scores" above,) 

To test whether pre/posttest gains are greater than could be expected by chance alone, OREA uses a /- 
test. To test whether a difference between two proportions (e.g., program and mainstream attendance rates) is 

i n 



greaJer than could be expected by chance, OREA uses a z-test and reports the differences between the iwo 
proportions. The level of significance is set at ,05 for all tests. 

Techniques For Minimizing Error 

The evaluation procedures minimize error by providing for proper administration of evaluation 
instrumeats through a combinatioa of testing at U-month intervals, appropriate analysis procedures 
and reporting. 

Instruments of measurement include the LAB (see above), the Degrees of Reading Power (D,R,P.) test, 
the Metropolitan Achievement Test-Mathematics (MAT-Math), El Examen de Lectura en Espanol (ELE), 
Likert-type scales (see above), and project-developed tests. Except for Likert scales and project-developed tests, 
these instruments are scored on a citywide basis at the Scan Center of the New York City Public Schools. 



AJ^PENDIX B 



INSTRUCTIONAL MATERIALS 

E,S.L, 



l\ew tjonzonsy dooks x oc ^ 


Mellgren &l Walker 


Addison -Wesley 


1984 


Turning Points, books 1-4 


lantorno 8l Papa 


Addison-Wesley 


1987 


English ^^ith a Smile, books 1-2 


Krulik & Zaffran 


National Textbook 


1987 


Elementary Reader in English 


R. Dickson 




1983 


An 0. Henry Reader 


Mellgren & Walker (ed,) 


Addison-Wesley 


1984 


Myths and Folktales 


Potter & Robinson 


Globe 


1980 


N.LA. 








Chinese Language Arts, books 1-3 


Byounghye Chang 


Lesley College 


1983 


Chinese Step-By-Siep 


G. Wang 


Addison-Wesley 


1986 


Mathematics 








Integrated Mathematics /, II, III 


Dressier & Keeiian 


Anisco 


1980 


Concepts and Applications: 




Harcourt, Brace. 




Key Ideas in Mathematics 




Jovaaovicfa 




Science 








Concepts and Challenges in Science 


S. Wolfe 


Globe 


1975 


books 1-3 








D.J ' D • 7 

Pathways in Biology 


J. Oxenhorn 




1974 


Biology and Human Progress 


Tanzer & Scawart^ 


Prentice Hall 


1986 


Physical Science 




D. C, Heath 


1989 


Physics: Principles and Problems 


Murphy & Sniooi 


Chas. E. Merrill 


1982 


Social Studies 








The Unfinished Journey: 


M. rerry 


Houghton, Mifflin 


1980 


/I woriu jnisiory 






People and Our World 


Kownslar 8l Smart 


Holt, Rinehart, 


1981 


World History: 


Janizen, Neill, & 


D. C Heath 


1988 


Perspectives on the Past 


Krieger 






Civics, Citizens, and Society 


Kownslar &l Smart 


McGraw-Hill 


1983 


Government and You 


Killoran. Zimmer, &l Fischer 


Am SCO 


1987 


Triumph of the American Nation 


Todd & Curtis 


Harcourt, Brace, 


1986 


Economics: Institutions & Analysis 


Gerson & Ante 11 


Amsco 


1987 


Exploring Our Nation's History 


J. O'Connor 


Globe 


1969 


Exploring the Non-Western World 


Schwartz & O'Connor 


Globe 


1976 



.(0 



